Statistical mechanics of combinatorial auctions 
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Combinatorial auctions are formulated as frustrated lattice gases on sparse random graphs, allow- 
ing the determination of the optimal revenue by methods of statistical physics. Transitions between 
computationally easy and hard regimes are found and interpreted in terms of the geometric struc- 
ture of the space of solutions. We introduce an iterative algorithm to solve intermediate and large 
instances, and discuss competing states of optimal revenue and maximal number of satisfied bidders. 
The algorithm can be generalized to the hard phase and to more sophisticated auction protocols. 

PACS numbers: 89.65.Gh,75.10.Nr,05.20.-y 



Auctions constitute an important part of economic ac- 
tivity \\. With today's pronounced role of e-commerce 
and the use of the internet as a world-wide market place, 
fundamental changes have occurred in the use of auc- 
tions. Their popularity has increased due to freely ac- 
cessible web services, and both the range and the nature 
of objects which can be bought and sold have diversified. 
Single-item auction protocols are however inappropriate 
when the number of objects to be sold is large, especially 
if buyers are interested in bundles of objects with com- 
plementary features. In such cases, it is preferrable to 
allow buyers to bid on combinations of objects instead of 
single items. Such auctions are referred to as combina- 
torial auctions (CA). Initially motivated by the problem 
of airport time slot allocation and by the distribution of 
radio spectrum licenses, CA are now widely used in a va- 
riety of contexts Q- Finding the maximum auctioneer's 
payoff allocation to a given CA is a computationally hard 
problem requiring exponential time resources. Fast and 
efficient heuristic algorithms are thus needed to identify 
optimal or close-to-optimal allocations, and models of CA 
are here of interest as theoretical benchmarks 0, Q . 

In this Letter, we will first map a generic CA problem 
onto a geometrically constrained lattice gas defined on 
a sparse random graph, coupled to a local chemical po- 
tential. This allows us to relate the computational com- 
plexity of determining optimal allocations to the glassy 
behaviour induced by the geometric frustration of the 
system. The latter here results from conflicting bids. 
The statistical mechanics approach to Bethe lattice glass 
models [j| then allows us to characterize the typical prop- 
erties of large random instances of CA, and to formulate 
algorithms for solving single instances. 

A simple CA model describes N players and a total set 
of M items to be sold. Each player i bids for an individual 
subset Ai C {1, . . . , M} for which he is willing to pay a 
price v.i > 0. It is understood here that the player is 
only interested in the full set Ai, but not in any proper 
subset. The bid of player i is thus given by the pair 
(Ai,Vi). More complex CA where bidders submit lists 



of m > 1 subset-price pairs, {(Aj, vf)}l=i,...,m nested 
by logical ORs or XORs can be reduced to the case of 
single-item bids, with a possibly enlarged set of bidders 
and items Hence we shall confine our discussion to 
the Hi = 1 case of single-subset bids. 

Let us indicate a successful bid by x% — 1, and an 
unsuccessful one by X4 — 0. Then the winner determina- 
tion problem (WDP) consists in finding a 'configuration' 
x = (x\, . . . , xm) S {0, 1} , which maximizes the auc- 
tioneer's revenue R = ViXi and respects the constraint 



that each item be sold at most once, i.e., that XiXj 







whenever Ai fl Aj 7^ for a pair i 7^ j. It is also in- 
teresting to discuss how far the optimal solution is from 
a configuration maximizing the number N s — J^. Xi of 
satisfied bidders. These two tasks are usually conflicting, 
and can be formulated as a multi- objective optimization 
problem whose outcome depends on the optimization pri- 
ority. In particular we will compare results of procedures 
first maximizing R and then N s , and vice versa. 

Deciding which bids (Ai,Vi) are successful (xi = 1) 
is a non-trivial optimization problem, because bids can 
overlap. If Ai f] Aj ^ for some i ^ j, the two bidders 
i and j cannot simultaneously be successful. Even an 
agent with a high bid Vi is not guaranteed to win, as it 
may be advantageous for the auctioneer to allocate the 
items contained in Ai to a number of other agents having 
a higher aggregate revenue. Indeed the CA optimal allo- 
cation problem is NP-complete, as can be demonstrated 
by its equivalence to the weighted set packing problem 
[3. NP-completeness, however, refers to a worst-case sce- 
nario and does not necessarily imply that one cannot find 
the optimal solution for some large real-life CA problems. 
Here, we focus on a simple probabilistic model where each 
player submits a single bid. This setup retains the same 
level of computational complexity as more general cases, 
and the WDP can be reduced to computing the ground 
state of a lattice gas defined on a suitable random graph, 
where particles residing on vertices are subject to a geo- 
metric constraint as well as to a local chemical potential. 

The Model — Let us take N players and M = aN 




FIG. 1: (Color online) Example of a CA interaction network: 
factor graph (left), and corresponding conflict graph (right). 
Bidders Bi are indicated as circles, items g a as squares at- 
tached via links to all the bidders wanting to pay for them. 
In the conflict graph bidders are connected by a link if and 
only if they share at least one item. Any item of degree k in 
the factor graph corresponds to a fc-clique of vertices in the 
conflict graph. I a is the set of players bidding for item a. 



items, with a — 0(1). Player i bids for a subset Ai 
containing £j items, and any item a in turn is chosen by 
k a agents. Any realization of this bidding structure can 
then be represented by a factor graph containing bidder 
and item nodes, cf. Fig. ^ A compact representation is 
given by the conflict graph (CG), in which two players i 
and j are linked whenever Ai n Aj 0. More complex 
bidding protocols can be cast in the same formalism [lfj . 

The CA can be mapped to a lattice gas of particles 
on the CG, with occupation variables Xi € {0,1} rep- 
resenting the bidders' success/failure. The Hamiltonian 
H. = —R = — ^TjiViXi describes a coupling of Xi to a lo- 
cal field Vi , and it can be associated with a formal inverse 
temperature (3. A chemical potential /i allows to control 
the particle number N s = X^ 2 -*- The grand-canonical 
partition function of such a lattice-gas reads 



where C is the set of edges of the CG. The product over C 
implements the compatibility constraint that each item 
can be sold at most once, and can be interpreted as a 
volume exclusion for neighbouring lattice sites. Temper- 
ature and chemical potential can be used to select com- 
patible solutions in configuration space: (i) the choice 
j3 — > oo and \x = corresponds to configurations max- 
imizing R independently of N s , (ii) (3 = and fi — > oo 
selects configurations maximizing N s only, (Hi) (3 — > oo 
before /i — ■+ oo: maximizes N s within the subset of 
configurations of maximal revenue, (iv) fi — ► oo before 
[3 — * oo: maximizes R within the subset of compati- 
ble configurations of maximum number of satisfied bid- 
ders. The maximal revenue can thus be computed as 
R* = ]imp—> 00 dp In Z at finite fi, and the maximum 
N* = liiiLj^oo <9 M In Z at finite (3. 

The cavity approach — The search for optimal 
configurations can be performed efficiently via algorithms 
based on the cavity method. For a general presentation 
of the method see e.g. 0, || and references therein. Fol- 
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FIG. 2: Illustration of cavity biases and fields. 



lowing [8j, one can introduce cavity biases {u a ^i} and 
cavity fields {hj_, a } associated with the links of the fac- 
tor graph of a single CA instance as illustrated in Fig. [21 
The cavity bias u„_^ measures the likelihood that item a 
is already assigned to another bidder k G I a \h and can- 
not be sold to i. The cavity field hi—> a is then given by 
the re-weighted price minus the sum of all Ub->i arriving 
from b £ Ai except from a. It measures the likelihood 
that the bidder would win if his bid did not contain item 
a. The resulting self-consistent equations are the basis of 
the so-called belief propagation (BP) algorithm: 



— >i 



u({h k ^ a }) 







p \ fcei„\» 



hi->a = h(v>i,{Ub^i}) 



H + (3vj 
(3 + n 



(2) 
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If the iteration of Eqs. (0 converges to a fixed point, we 
can estimate the probability that bid i becomes satisfied: 



Pi = Pfa = 1) 



exp{(n + P)Hj} 
l + exp{(/i + 



(3) 



with an effective local field H{ = (fx + [3vi)/([3 + (j.) — 
J2beA u b~*i- The payoff estimate becomes J2i R = v iPii 
and the expected number of satisfied bids is N s = J2i Pi- 
The maximization of these quantities can be achieved 
by tuning (3 and fi as described after Eq. QJ. In principle, 
the limit (3 — >ooat/i = 0- corresponding to a maxi- 
mum revenue - can be taken directly in Eqs. (0, and 
has a simple interpretation. In this case it a _>i is a warn- 
ing to bidder i that he needs to allocate at least a price 
u a ^i to item a in order to outbid the other players in I a . 
Consequently, in order to secure his subset Aj , he has to 
offer at least J2 a 



,j. The field Hi is thus given by 
the difference between the amount i is willing to pay and 
the minimal amount required for i to win. If Hi > the 
bidder will be successful (xi — 1) with probability 1 (i.e. 
in all such solutions), whereas Hi < indicates a loosing 
bid. Players with Hi = are successful in some opti- 
mal assignments, and unsuccessful in others. In order 
to deal with the latter degeneracy, one has to resort to a 
more subtle limit of Eqs. @, allowing for fields vanishing 
proportionally to the formal temperature. 



Eqs. (|2J) are valid for any fixed choice of the graphs, 
prices and bids, i.e. the effective fields can be determined 
for any specific CA instance. They can be solved itera- 
tively in O(N) steps whenever the iteration converges. 
The fields {Hi} at convergence of the BP iteration can 
be used as input for an iterative search/decimation proce- 
dure, where items are assigned iteratively to bidders with 
highest Hi, and BP equations are then iterated for the 
reduced problem containing only variables not yet fixed 
in the previous step. This procedure runs in O(iVlogiV) 
steps if a finite fraction of items is assigned at each step. 

Solution for typical cases — To extract analytical 
estimates for the CA outcomes we average Eqs. (0) over 
given random factor-graph and price ensembles. In doing 
so we obtain self-consistent integral equations for the or- 
der parameters, i.e. the histograms of both the cavity bi- 
ases (Q(u)) and the cavity fields (P(h)). In the so-called 
replica symmetric (RS) phase [3,0 > these equations are 

oo £ 

P(h) = Y,P* \\du t Q{u t ) duP{v\e + l)5(h-h) 
e=o t—i 

oo „ k 

Q(u) = Y,<lk j[[dh t P(h t )S(u-u) (4) 

fc=i t=i 

where P(v\£ + 1) is the distribution of prices v for agents 
bidding for sets of £+1 objects, h, u are given by (J2J, pe = 
(£ + l)p£ + i/{£) and q k = (k + l)q k +i/(k), where p e and 
q k are the degree distributions of the bidders and items 
in the factor graph. Eqs. {3} are solved via population 
dynamics || . Here we focus on two simple non-trivial CA 
ensembles. In both cases, every player selects each item 
independently with probability z/M. The probability 
that a player wants £ items is Poissonian, pi = e~ z z /£ !, 
for large M. Similarly, the probability that a given item 
is chosen by k players is q k = e~ x X k /kl for large N, 
where A = z/a. The considered ensembles differ in the 
prices the bidders are willing to pay: 

(i) Constant prices — Every bidder who bids for at 
least one object offers the same price i>i = 1. BP- 
results from Eqs. (@J are shown in the inset of Fig. [3] 
together with optimal revenue estimates from simulated 
annealing. Note the maximum of the revenue for inter- 
mediate z. At small z many items are not element of 
any bid and do not contribute to the revenue, while at 
large z items are desired by multiple players resulting 
in conflicts which restrict the revenue. The main body 
of the figure shows analytical results 0] on the valid- 
ity of RS. Above the phase boundary conflicts induce 
replica-symmetry breaking (RSB), i.e. a clustering of 
CA solutions into disconnected sets. RS results cannot 
be trusted beyond that point and multiple metastable 
states are found. Note that RSB in the typical case cor- 
responds to non-convergence of BP on relatively large, 
randomly generated single instances of CAs. This is con- 
firmed by the symbols, which mark the points where BP 




FIG. 3: Phase diagram for constant-price CAs in the (a, z)- 
plane: in the lower region, all solutions (maximum-revenue 
configurations) belong to a single cluster, and RS equations 
are believed to give the exact revenue result. In the upper 
region the RS solution is not correct anymore. The symbols 
mark the point where BP stops to converge on ~ 3% of the 
spins (N = 5000, averaged over 20 instances), and are con- 
sistent with the line at which RS breaks. Inset: Maximal 
revenue per item vs. z for a = 0.5, 1, 1.5 from top to bot- 
tom. Average RS results (lines) are compared to simulated- 
annealing data on single CA instances (markers). Results ob- 
tained by iterating BP on the same CA instances (not shown) 
are consistent with these curves. 



stops to converge. 

(ii) Linear prices — In this second, potentially more 
realistic case the price of a bid is assumed to equal the 
size of the desired subset, i.e. the price per item is con- 
stant. Qualitatively, the revenue curves show a behaviour 
similar to the constant-price case, cf. Fig.^J For small z, 
the revenue is very close to I — e~ A , the fraction of items 
wanted by at least one bidder. Even if there is little frus- 
tration, it is not possible to sell all items as it would be 
optimal for the auctioneer in this case For larger z, 
replica symmetry breaking sets in as a result of increasing 
frustration, and asymptotically the revenue curves are ex- 
pected to decrease again with z. The increasing level of 
frustration can also be seen in the fraction of successful 
players in the group of players placing non-empty bids. 
As also shown in Fig.0] this fraction is found to decrease 
monotonously with z, i.e. with the average number of 
items wanted by a bidder (at fixed a). 

(Hi) Other ensembles — Other CA ensembles give rise 
to even more complex phase diagrams. For instance, in 
the elementary case of each player wanting a fixed num- 
ber K of randomly chosen items, all at the same price 
(corresponding to Vi = const), one finds that the space 
of optimal solutions is divided into an exponential num- 
ber of geometrically distant clusters even for values of 
a at which all items can be assigned without frustra- 
tion. This corresponds to a 1-RSB mechanism observed 
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FIG. 4: Revenue (increasing curves) and fraction n 3 of sat- 
isfied players in the set of players with non-emtpy bids (de- 
creasing curves) for the four optimization problems (a = 1). 
Maximisation order is as follows: (i) R only (full lines), (ii) 
N 3 only (dashed lines), (Hi) R before N a (dash-dotted lines), 
(iv) N s before R (dotted lines). Revenues for (i) and (iii) 
indistiguishable, n a for (ii) and (iv) indistinguishable. Sym- 
bols mark the points where RS breaks down, RS results are 
approximations at large z. The upper most increasing line 
marks the fraction of items which are part of at least one bid, 
i.e. the theoretical maximum number of auctionable objects. 



in other hard combinatorial problems f8j. In such a re- 
gion (e.g. a G [.56, .59] for K = 5) message-passing al- 
gorithms provide efficient techniques for finding 
optimal assignments. 

The extension to CAs with generic price distribution 
is straightforward and will be presented elsewhere [Toj| . 

Let us finally mention that the case of linear prices 
allows one to study multi-objective strategies for solv- 
ing the WDP going beyond standard CA theory which 
is mostly concerned with revenue maximization. As dis- 
cussed before, one could also aim to maximize the num- 
ber of satisfied players. As shown in Fig. 0] doing this 
after maximizing the revenue has only very little effect 
on N s . On the other hand, maximizing N s independently 
of the revenue leads to a substantial decrease in R. The 
latter can be partially cured by maximizing the revenue 
within the set of winner assignments of maximal N s , but 
also there the revenue remains well below its maximum. 
A suitable strategy of taking into account both R and 



N s might be to send both (3 and // to oo, with a fixed 
ratio [3/li controling the relative importance of either op- 
timization task. By varying it one can continuously tune 
the results between the extremes given before. 

To conclude, we have presented a statistical physics 
approach to the CA problem and introduced an itera- 
tive algorithm for solving the WDP of large instances 
of simple CAs. A relatively large body of literature 
has been devoted to algorithms for solving WDP, such 
as branch-and-bound and mixed integer programming 
techniques (see @, Q and references therein). It would 
be interesting to compare the performance of message- 
passing algorithms with the existing approaches to WDP, 
as it has been done recently for satisfiability problems in 
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